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ABSTRACT 

Computer coaching of students as an aid in 
problem-solving instruction is discussed. This reporr describes an 
advanced fern cf computer-assisted instruction that must not only 
present the material to be taught, but also analyze the studenr's 
responses- The program must decide whether to intervene and how much 
to say to a pupil based on its knowledge of the player or players in 
an ever-changing context. The focus of this project is problem 
solving using the Wumpus Game. An evolution of computer coaches from 
a simple rule-based approach to a irore complex model xs described- 
(MP) 
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This report describes the evolution of a problem solving model over .several generations of 
computer coaches. Computer coaching is a.type of computer, assisted -inslaJctionJn_v^hich — 
the coaching program observeo the performance of a student engaged in some intellectual 
game. The coach's function is to intervene occasionally in student generated situations to 
discuss appropriate ckills that might improve the student's piay. Coaching is a' natural 
context In v;hich to investigate the teaching and learning processes, but it is a demanding 
task. The computer must be able to analyze the student's performance in terms of a model 
of the underlying problem solving skills. This model must represent not only expertise for 
the task but also intermediate stages of problem solving skill and typical difficulties 
encountered by the learner. Implementing several generations of computer coaches to meet 
these demands has 'resulted in a model that represents problem solving skills as an evolving 
set of rules for a domain acting on an evolving representation of the problem and executed 
by a resource-limited problem solver. This report describes this evolution from its starting 
point as<^a simple rule-based approach to its current form. 



Keyv/ords: Information processing psychology, artificial intelligence, computer assisted 
instruction, cognitive science, knowledge representation, computer games* 



^ This report was published in Reif, F. and . D. T. Tuma (eds.), Problem Solving ' and Education: Issues in 
Teaching and Research, Lawrence Eribaum Associates, Hillsdale, New Jersey, 1980, pp. 53-80. 
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Computer coaching is an advanced form of Computer Assisted Instruction. 

The VVumpus Game has served as our experimental testbed. 

Our first step was to represent problem solving skills as a set of rules. 

Our second step was to represent problem solving skills as an evolving set of rules. 

Extending the coach's representation of problem solving skills improves its student, 
modelling capabilities. 

A Student Simulator was implemented to explore the beljavior of different skill models. 

Our third step was to represent the associated data structures. 

A Display-based Wumpus game was implemented to explore the role of data representatio 
We are now in the process of implementing a coach for Display Wumpus. 

Our fourth step was to represent the resource limitations of the problem solver. 

An elementary method for estimating the complexity of the game was -implemented. 
A tlieory-based estimate of cognitive load is needed. 

There are more steps to be taken in constructing an adequate problem solving model. ' 

A computational theory of problem solving has many educational applications. 
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For several years, we have employed an unusual niethotlology to study problem solving skills. 
Kallier than observing studenLS iolorncting with human teachers, we have Or :rvod ilieir interaciioni^ 
with computer coaches. This has provided us widi a controlled cnviroimicni for studying leaching 
and learning. Our evaluation measure has been the adequacy of a problem solving theory to 
support successful tutoring by the coaching program, 

* Ihis paper describes research done Willi my sludcnu and co'lleagucs at MIT, especially Jim Slansfield, Brian Carr, Kurt 
van Lehn, Barbara While. David Ihric and Sandor Schoichei. It has also benefited from a close collaboration with John 
Seely Brown and his colleagues at Boll, Ikranek and Newman, 

Developing a computational representation for problem solving skills is obviously difficult. 
Hence, our strategy has been to develop dVis representation in an incremental way. 

The first step introduced a representation for expertise as a set of rules< This gave 
die coach a description of the goal stale of the teaching process, 

Tlie second step added a representation for the evohiiion of these rules in which 
different levels of skill were described explicitly. - 

1he third step added a representation for the data structures employed by die 
student, since his problem solving skills clearly include strategies for structuring the 
problem. 

The fourth step added a representation for the cogniliy(? resources of the student, 
since otherwise the coach could nut distinguish between problems requiring the 
same skills but making different demands on memory and processing power. 

Before recounting this evolution, it is useful to observe that our research differs significantly 
from traditional studies of problem solving typified by Polya [1957]. Polya concentrates on 
enumerating useful heuristics. Our research is complementary, being less concerned with problem 
solving heuristics Oian with arriving at a general representation for such heuristics within the overall 
problem solving context. Hence, many of our rules are domain specific. But die overall- 
architecture - a processsor applying rules, manipulating data stmctures, and construcdng new rules 
from old - is general. In a sense, we have focussed more on the form than on the content of 
problem solving. However, deriving a better understanding of the architecture of problem solving is 
crucial if we arc id embed the presentation of particular problem solving skills within a more 
comprehensible frainework. It is also cnicial if we are to develop an improved educational 
technology based on amjp^Liters^^^^^ " - ' 
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Computer coachlnj4 is an adviinceil form of Computer Assisted Instruction. 

In traditional computer assisted instmction, die computer's understanding is minimal. Generally, 
the material is represented as a script, and the computer's funcdon is to direct (he presentation of 
material based on keyword responses to pre-programmed queries. Computer coaching, however, 
does not allow such cookbook methods. The coach must advise players in a constandy changing 
context. To meet Uiis objecdve, coaching systems have the structure shown in figure K 

H 'Ilie Kxperi module generates solutions to the student's problem. Within the gmne 
context, diese solutions are analyses of the pros and cons of alternadve moves. To 
formulate Uiese analyses, the.Hxpert uses a procedural representation of problem 
solving skills for the domain. Thus, Uie design of the expert requires a formal and 
complete study of die knowledge demanded by die task..- 

# 'Ilie Psychologist mod.ulc must compare die Expert's analysis with the student's 
performance to hypothesize which skills the student understands. 'These hypotheses ' 
are stored in an Ovciiay Model, a tenn I use to emphasize diat die model is defined 
in terms of the coach's o^'erall understanding of the problem domain. Inferring this 
model is a difficult task for human teachers. Hence, if the computer coach is to 
succeed in its restricted world, it must take recognizance of as many sources oF 

evidence as we can make available to it."~TheiWb;cr'tlTe Tfcsign-o^dTe-Psyeho^^ 

focusses on developing programs to examine the student's^ play, ask occasional 
questions, request a background qiicsdonnairc and assess the intrinsic complexity of 
material in- the syllabus. 

# 'Ilie Tutor module is alerted by die Psychologist to situations in which the student • 
has not employed a skill and hence made a less than opdmal move. The Tutor' 
must then decide whether to intervene and how much to say. This decision is made 
by employing a set of teaching heuristics. Mence, die design of die Tutor directly 
raises both educational quesdons related to the nature of explanations and linguisUc 
questions related to. the expression of diese explanations in Englisl^ 

Mlius, coaching systems are complex, requiring a representation both of the skills to be tiuight, 
and of the procedures by which modelling and tutoring can be accomplished. Our coaching 
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programs rolloct this complexity boih in their si/e (several luiiulroci thousand words of code) anti 
their devclo|)nie!U time (typicnily several man years). 'To date, coaching experiments hiwe been 
coiuUicted for a limited, but interesting ranco of domains including geography [Carbonell, 1970], 
electronic tTOtibleshooting [Urown, lJurton & Ikll, 1975], nticlear magnetic resonance spectra analysis 
[Slceman, 1975], medical diagnosis [Clanccy, 1978], progranniiing [Miller, 1978], and nialhematical 
games [Hurton & Drown, 1976; Goldstein & Carr, 1977]. 

't-^MivlJiis paper, however, I shall eschew the broad view by applying a microscope to the central 
box 'of figure 1. Developing a satisfactoiy representadon for problem solving skills is clearly 
essential to the design of coaches, as the centrality of die box in the diagram indicates. 



JT|he Wunipus Game has served as our experimental testbcd. 

In 1975, we began an examination of procedural models for problem solving in a game 
environment. We choose a game environment based on Burton and Brown's [1978] experience with 
a coach for the Plato project's aridimetic game How the IVesi was IVon . They found games to be 
a motivating but nevertheless constrained environment that was well^ suited to the coaching 
paradigm. ^ - • 

* Wnsr is a simple board game in which the player moves by ronning an arilhinetic expression rrom three spinners, 
'["he game is a ruce and hence Uie player's usual goal is lo rorni the Inrgest expression, with the typical alternatives or 
bumping your opponent or landing on special squares. *l'he student gains experience with-aiilhmetic by searching ror the 
optimal expression. The coach tracks ihe student's choice or move and offers advice about arithmetic skills not being 
employed by the student in situations where their use would be of value. 

Following Btirton and Brown's lead, we designed a coach for Wumpus, a computer game 
invented Ijy Gregory Yob [1975]. Tlie game is a modern day Theseus and the Minotaur in which 
tlie player's goal is to slay die Wumpus. The game's virtue is that an interesting variety of logical 
- and probabilistic reasoning skills are required to play skillfully. To define the game, I have 
reproduced the introduction printed by the coach. 



You are a world-reno wneiLhuntcr-descendrng^dom^^ of darkness, lair 

~~of the infamous man-eating Wumpus, To win the game, you must kill the Wumpus 
by shooting one of your five arrows into his tairfroni a neighboring cave. If you go 
" into the cave of the Wumpus he will eat you. Within the warren there are two other 
kinds of danglers, bats and pits. The pits arc bottomless and fatal if you fall into ' 
of Ihem, If you visit the home cave of bats they will pick you up and carry you to 
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another cave which mlyjit contain the Wumpus or a pit (either of which is futalX 

You can nain information about the warren fhrou^\h exploration. If bats are in 
one of the neighboring caves you will hear their high- pitched squeaking* Likewise, if 
you are next to a cave with a pit you will feel a chilling dnijl If you are near the 
Wumpus. you will smell his horrible stcncli 

Before you shoot an arrow, you should consider the fact that if the Wumpus is 
not in the cave, the arrow will start ricocheting^and may kill yqu (and it is an 
agonizing death), If it does start ricocheting, there is roughly a one third chance that 
it will kill you. If you ivn out of arrows^ without slaying the Wumpus, you are • 
doomed to wander forever until you die. 

Your only companion in this endeavor is the wise old sage, Wusor. If you make 
a hasty move. Wusor may stop you and give you advice, but the fuial decision^ rests 

)\ith you. , * 

# 

Following this introduction, a typical game might proceed *as follows. The student is Mary, a 12 
year old player. 

///; Mary. There are 15 caves, 2 bats, 2 piis and I Wumpus, You are at cave 15 . 
with neighbors < 14 and 0, Brrr! There is a draft. You are near a pit. What now? 

> I 

1 ■ . . 

You are at cave 4 with neighbors 15. 14 and 2. Brrr! There is a draft. Squeak! A 

bat is near. 

As figure 2 illustrates, many players draw maps and/or tables to keep track of their exploration 
of the warren. Figure 2 shows the map drawn by Mary for this_purposc_as__well- as alternative 
represeiitati^_s_employed— by other- students^ 



Wumpus is colorful and challenging, thereby capturing tlie interest of a wide range of playerg. 
Adults typically invest several hours to master the game: children several days or weekS; Locating 
multiple dangers in a randomly connected warren requires skills of logical deduction, 'probabilistic 
inference, problem representation, and overall strategy selection. For example, consider Mary's 
situation. 
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Krom a loglcul slandpoliu; Mary slioultl Infer that cave 2 contains a bat since (1) the 
squeak in cave 4 impiics lhi^\ a bat is in either cave 2 or M, but (2) the al)Sonce of a 
squeak in 15 rules out 14 as a possibility. As Mary*s game progresses^ opportunities 
will be commonplace for arguments by elimuialion, by cases or by contradiction. 

Pvoiw a probabilistic standpoint, Mary should infer diat cave 14 is more dangerous 
with respect to pits than 0 or 2 on the basis of the muUiple warnings. The multiple 
warnings for a pit do not determine the location of the danger, (If there were only 
one pit, this would" be not be true.) I3ut muUiple warnings do imply that cave 14 
should be treated as more likely to contain the pit. An expert player typically makes 
approximate numerical judgments of the probabilities when logical inferences are 
insufficient to locate safe caves, ' - ^ 

From t\ problem representation standpoint, Mary's map is a useful artifact" for 
representing the problem. Many students initially choose tables, which make 
deductions about connectivity difficult. There are, however, other representational 
devices that prove useful such as lists or tables. The most challenging aspect of the 
game for many players is to derive an adequate representational scheme. 

From a strategic standpoint, Mary must recognize that her goal is to avoid the more 
dangerous caves while still gaining information ' about the warren. Strategic 
considerations grow more complex as the number of arrows arc exhausted or tlie 
time to complete the gam.e grows short. 



lliis analysis only sketches the requisite knowledge, but it demonstrates tliat skilled play does 

pose an intellectual challenge. Indeed, the game is sufficiently complex to exhibit a plateau 
phenomenon in which players occasionally stagnate at particular levels of skill. Tutoring is then 
required to facilitate further learning. Hence, the game is not an artificial environment in which to 
.study problem solving. 
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Our first step was to represent problem solving skills as a set of rules. 



In 1976 wc implcinciucti a coach in which Iho nialhcnialiciil and probabihslic skills wcM to 
play Wumpus wore rcprcsciUcd by approxiinaloly 25 rules IdoUlstcin Can, 1977|, The rules fell 
into two catefiorics: those iliat decUieed evitleiicc about the warren and (hose ihat made siralcgic 
decisions on the basis of diat evidence, A few arc illustrated below; 

Typical Rvidence Rules: (These rules construct sets of caves diat represent hypotheses about die 
locations of different dangers. The context for all of these rules is diat die player has just 

entered a cave in the warren and been told its neigliboi^ and its warnings,) 

' J ... 



ERI: Acid the imvisiied neighbors to the set of FRINGE caves. The FRINGE set 
' ^ records thoie cdlves that have not yet been visited but can be reached froni^^ 
the player's current location in the warren, 

ER2P: If there Js not a pit warning, then add the neighbors to PIT-, Pir is the set 
of ca^es that do not risk pits, 

BR3P: If there is.a pit warning, then add the neighborslo pit-h, PITh is tffe^ of 

caves that > risk pits. ^^-^^ 
ER5P: If there is a pit xmningM neighbors is already in PIT-t, then 

add that-netgfibor to pm. PIT2 is the set of caves for which the player has 
nmltiple evidence of a pit. 

ER6P: If there is a pit warning, and all but one of the neighbors^ are known to be 
safe, then add thai neighbor to Pff^, PIT= is the se{ of caves, that definitely 
contain a pit. 

Similar rules are defined for the other dangers. The convention is employed that 
special case rules for particular dangers tire given names ending with the suffixes B, P 
or W, 



Typical Strategy Rules : (These mles are concerned with choosing^ the move based on die 
available evidence.) 



SRO: - Shoot an arrow if the Wumpus* lair if» found that is, shoot if a cave is added 

to WUM^r, 
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iS'AV; l^xphro s({/h caves, that Is, vxploro any vaves In the huomvilon ofPn\ HAT^ 
and wwh 

' SlU: Explore mes Implicated hy single wamlnns he/ore caves Implicated by 
multiple mwilny.s, that ts\ (fpossslhle, prefer caves that are not In nAN(llH^3 
sets, 

SliJ: Explore caves that only risk bats, that Is, prefer elements of liATf-, 

SIN: If no other sirategy rule applies explore any available frlnRC cave, Le, any 
member of llilNU!-:, 

Similar A/m/oiv rules express preferences for other combinations if risk as recorded In 
the various evidi^^nce sets, • 

These rules were' applied in a fixed order, with the strategy rules heing more sensitive to tlic 
ordering chosen than the evidence rules, 

lliese rules are problem specific. Hence the question arises whether or not the coach conveys 
any general problem solving knowledge. My reply is tliat these rules implicitly embody important 
general skills such as (1) argument by elimination, (2) the use of sets to represent hypotheses, and 
(3) tlie sequential organization of a set of heuristics. It is true that the coacli does not understand 
them in this fashion: its orientation is problem specific. However, a reasonable hypothesis is thiat 
general problem solving skills can be profitably taught through' problem specific situations. This is 
not a radical position since it accords with the traditional philosophy of learning by doing. 
Eventually, we will conduct^ experiments to learn if the implicit skills of Wumpus do transfer to 
other situati(5ns. But our current focus is on the prerequisite goal of developing an adequate 
representational formalism to incorporate the required problem solving knowledge into a coach. 

Within the computer, these rules are represented as a set of attribute value pairs. The 
description for nR3P is shown belovy: 

DESCRlP i ION OF RULE EU3P 

ATTRinUTE ' VALUE 

TYPE I-VinnNCE-RULE ' 

ENGLISH % IF A CAVE HAS A DRAFf, THEN, THE NEIGHBORS 

" , POSSIBLY RISK PITS. 

CONUmON IS "DRAFT'' A WARNING OF THE CURRENT CAVE? 

ACnON ADD THE NEIGHBORS OF THE CURRENT CAVE TO PIT+. 



10 



10 



'\^\o mics m rcproseiUPtI In ilih lonn, m\w [\m\\] iis linos ofcoilo In ii Uww vmrm, lor iwo 
icasoHH. P1rsi, iho coat^h must {llM^nor.o Hluinllmis iho siucloiu knows iho IndivMiiul rules hiii 
nppllos In lliQ wrnnu mkw Sucond, ilvo coach moHi know lacis for o^plninlng ihc rule iliat 
m noi onseniliil Ibr ihcir csfvutlotu hulccti, this second point ruiilly encupsulaics ihc (heme of ihls 
pi\per. Our llrst rule-nrlcnicd,reprcscnniih)n for prohloni soIvIur skills was atlci|Uiiie U) dellne an 
oxpcrl program, hui was lusullkkMU H) ftuMo a loachlni^ proaranu Our ihroe oMonslons a(Klrosjio<l 
Ihls llnillallon hy supplying knowlodac about prohloui soIvIub skills diat a loachor roiiidros U) 
OH|)lain dioui successl\dly, 

hasod on diose rules, die coach was able to olTcr die followinB khul of advice, Mary has Just 
chosen to move to cave 14 In die siuiation illustrated In (Iguro 2: 



ExplamUion HI: Mary, it isn't necessary to take such lary.e risks with pits. Multiple 
evidence is more dangerous than single evidence for pits. Here there is multiple 
evidence for a pit in 14 and sin\ile evidence for a pit in 0. Perhaps we should explore ( 
cave 0 instead. Do you want to take back your move? 

\ 

'Ihis explanation was generated by a set of templates applied to a /mw/ generated by die Expert 
module that move 0 is better Uian move 14. The term proof is legitimate when die rules arc viewed 
as theorems of the domain. Kor example, die Kxpcrl produces die following (simplined) analysis, 
llic analysis is expressed in Knglish rather dian the equivalent internal computer rcprcscntadon. 



There is no scpteak in cave 15, ' ;Given, 

Therefore, cave 0 is a member of bat% ;By evidence nde ER211 

There is a draft in cave 15, ' iGiven, 

Therefore, cave 0 is a member of pit -h, :By evidence rule ER3P, 

There a draft in cave 15 and cave 4, " iGiven, 

Therefore, cave 14 is a member of pil2, ;By evidence rule ER5P, 

Conclusion, 0 is superior to 14, :By strategy rule SR2, 



^^l\is, our first Coach was essentially a mathematiciatl in the sense that it viewed the tutoring 
process from the theorem proving standpoint. Its goal was to infonn die student of the bUgs in his 
proof oi^ die current situation. Our experience with Uiis coach was Uiat students' generally enjoyed 
its advice. And. upon occasion, it successfully prodded students off plateaus by making them aware 
of poor moves. However, viewing students as mathematicians who need only be told the 
appropriate theorems is clearly insufficient as a model of the learning process. The next secdon 
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ilisciisscs how (ho luliliiinn of an hintorkul pt^iNpiViivo on iho tlovoiopnioni of Ihuso OuMiroinH 
hUjniriuiinUy iniprovo^ (ha mwWn ^^^\Mmn)/ powor, 

Our second slop was to icpimMit probkMU solving skills »s no \m)Mnp, sol of cuius. 

To apprecliuc why an hlMoiicnl pcrspuctlvo of prohluin solving skills nubt siipplunuMU Iho 
coach's basic niadicniailcal luulcrstanclinp, It Is uscM\il lo reexamine the iulvico olTcrccI Mary hi (he 
previous sccihin. Uccall thai she has uiiulo n poor uuivc (o cnvo M. '' he inaihcniatloal cxplanallon 
provlilctl is that she luis failcil to apply the douhlc evidence theorem, The central iisserilon was; 

lixplanaiion HI: Mary, it isn't necessary to take such lary,e risks witli pits, Multiple 
evidence is more^ dunsierous tluot single evidence for pits. ... 

This advice might he sunkiont. Indeed, in'Our-expcricnce, it is just right for some students. But 
the explanation does not take advantage of Mary's history. For example, if she has recently 
encountered a similar situation for am)thcr kind of danger, then an explanation thai cmphasi/.od the 
analogy would be appropriate. . - ^ 

lixplanaiion E2: Mary, it isn't necessary to take sucli large risks with pits. We have 
seen that multiple evidence is more dangerous than single 'evidence fo r bats . ... 



Or alternatively an explanation that emphasized the relevant gcncralizpMo 




Explanation E3: Mary, it isn't necessary to take such large risks with piis,- Multiple' 
evidence is more dangerous than single evidence for a ll danger s^ <:r 



Pmally the explanation might cmphasi/c the relationship of the new strategy to an earlier,* simpjificd 
view of the game. \ ... • 




Explanation E4: Mary, it isn't necessary to take such large risks with 'pits. In the 
past, we have distinmished between safe and dangerous, evidence . Now we should 
distinguish between single and nmltiple evidence for a danger. 



u ■ 
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I am not saying that ar.y one e?.planation is the correct one. However, I am saying that a model 
of learning and teaching must make provision for these alternatives. A teacher can then move 
^ among them as the student's history and responses suggest. 

Hie first mathematician coach did not have this flexibility. Its point of view was essentially that 
the student was an "empty bucket" in which knowledge was to bo poured until skilled performance 
was achieved. At any moment in time, the coach viewed tlie student's skills as a subset of those of 
tlie expert. It ignored the fact that acquisitioacf skills is a more complex process involving the use 
of analogies, generalizations and corrections to\uild new rules from previously acquired ones. This 
ignorance was reflected in its inability to stnicture an explanation in these terns. Clearly what was 
needcd'was an extended representation for describing the evolution of procedural knowledge from 
one level; of skill to another. 

We'provl^d this extended representation by employing a network formalism in which rules 
were repr^^sented as nodes and their evolutionary relationships as labelled links between these nodes. 
These labels designated various relationships by which one rule might be built from anotlier, 
f including generalization, specialization, analogy, and refinement. Figure 3 is a region of the 
' Wumpus nile network that exhibits these relationships. Examine rule r:Rl of figure 3. It is a , 
general stateir.ent tliat "If a warning occurs, then the neighbors for the current cave should.be added 
to%e set D-h representing possibly dangerous caves'' KR3 is a generalization of particular rules for 
bats,' pits and Wumpi. This is represented in the network by specialization linkr^ to nR3B. V.\U? and 
MR3W. (There are inverse generalization links from \i\U\y PR3I> and HR3W to ER3 which are not 
shown,) Kach of the specializations is connected to its brothers by analogy links, llie analogy - 
relationship is defined formally by tlie existence of a mapping from tliC variables of one special case 
mle to another. Finally, F.R3 is connected by refinement links to ER4 and HR5. A refinement is 
defined by breaking a rule's condition ox action into separate cases. Thus, ER4 and i:R5 are 
producpd by breaking the action of HR3 into two cases: one for single evidence and one for double 
evidence. I:R3-was in turn refined from liRl by breaking the condition of that rule into two cases: 
one for warnings and one for no warnings. , . . 

There is anothe,r vantage point from which to view the network. This is from the local 
^perspective of an individual mle rather than from the global rj^erspective of tlie overall network.. 
Recall that bur first representation viewed rules in isolation: tlieir description conLiined_ only 
properties fpr thefr condition and action. From a loeal perspective, the rule network is a derived 
.structure Uiat arises from augmenting individual rule descriptions with special connections to related 
rules. The rule description thus characterizes rules' as members of a society with both internal. and 
external relationships. In fact, tlie actual computer representation lakes tliis foim Each nile is 
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supplied with an augmented description, of which tlie one illustrated below is typical. 

KXTKNDKI) DKSCRIFHON 01^^ KUIJC KR3 P 
ATTRIBUTE VALUE 

COMMENT: THIS IS HIE' BASIC ~ RULE - DESCRIPTION. ^ 

TYPE EVIDENCE-RULE 

FjNGLISH IF A CAVE IIAS A DRAFF, THEN THE NEIGHBORS 

POSSIBLY RISK PITS. 
CONDITION IS "DRAFT" A WARNING OF THE CURRENT CAVE? 

ACTION ADD THE NEIGHBORS OF THE CURRENT CAVE TO P1T+. 



COMMENT: THESE RELATIONS DEEINE THE SKILL NETWORK. 
ANALOGOUS;TO r:R3B ER3W 

SPi:CIALIZATION-Or ER3 

'Hie network itself is derived from the connections between rules specified in the analogy, 
specialization and refinement attributes. 

'1 • ' • 

The coach cannot perform the learning processes specified by these attributes: the programmer 
supplied these interrelationships. However, given the availability of this network representation of 
the skills to be taught, the new coach now being completed will be capable of a more diverse set of 
explanations. The variations E2, E3 and E4 will be generated by using English templates to be 
triggered by the existence of evolutionary links between the specific rule that "double evidence for 
pits is more dangerous than single evidence", .and other rules in the skill network. The region of tlie 
skill network containing this mle is shOwji in figure 4, embedded within an Overlay Model 
describing the student^ knowledge state. ,The relationship of the network to Uie student model is 
the subject of the next section. 

Extending the coacirs representation of problem solving skills improves its student modelling 
capabilities. ^ . ' 

- '. ■ . 

In teims of modelling the student, our notion of an Overlay Model now becomes tliat of 
identifying the. skill nodes employed by the student and the evolutionary -links followed in the 
acquisition process. Figure 4 is a graphic representation of an Overlay Model maintained by the 
coach. -The coach keeps track of which rules it believes the student already possesses on the basis of 
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his or her behavior as well as the explanations it has offered to facilitate this learning process. 



The computer represents an Overlay model as additional infonnation within each nile 
description. Thus, the description for SR2P would include the following properties: 



DKSCRIPTFON OF RUI-K SU2P 



ATTRIBUTE 



VALUE 



COMMENT: THIS IS THE BASIC RULE DESCRIPTION. IT IS THIS STRATEGY RULE THAT 
OBJECTS TO MARYS CHOICE OF CAVE 14 AS HER MOVE. 
l-YPE STRATHGY-RUI.E 

ENGLISH IF THERE ARE CAVES THAT ONLY POSSIBLY RISK PITS. MOVE TIIERR 

CONDITION IS PITl A NON-EMPTY SliT? 

ACTION SET MOVES, THE SET FROM WMICM THE NEXT MOVE Wil.L 

BE CHOSEN, TO PITL 



COMMENT: OVERLAY MODEL INFORMATION FOR THIS RULE. 



EXPLANATIONS 
USED - 
APPROPRlXtE 

FREQUENCY 



KNOWS 



El \EI IS THE EXPLANATION JUST GIVEN TO MARY 

REGARDING THE INADVISAB'LITY OF MOVING TO CAVE 14. 

0 \THE COACH BELIEVES THAT M.iRY HAS NEVER USED THIS 

RULE. ^ 

.1 \TIIE COACH BELIEVES THAT THE RULE HAS BEEN ' 

APPROPRIATE ONCE. IN THIS^CASE, THIS IS IN CHOOSING 
NOT TO MOVE TO CAVE 14. 

0 ["FREQUENCY" IS THE RATIO OF "USED" TO "APPROPRIATE" 

AND REPRESENTS AN ESTIMATE, OF HOW FREQUENTLY 
MARY EMPLOYS THIS SKILL FOR SR2P, YHE COACH 
BELIEVES THAT MARY HAS NEVER EMPLOYED THIS RULE. 

NO \"KNO\VS" RECORDS THE COACIIS HYPOTHESIS FOR WHETHER 
OR NOT MARY KNOWS THIS RULE IT IS "NO" IF THE 
"FREQUENCY" IS LESS THAN .5. 



A Student Simulator was implemented to explore the behavior- cf different skill models. 



The Student Simulator is an environment for executing the rules specified in an Overlay Model 
Us function is to allow a teacher to explore the behavioral implications of different" hypotheses 
about a student's skills. Its value arises in tliose siuiationS in which the teacher is unable to predict 
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a priori the divergent behavior implied by different student models for complex problem solving 
situations. 

* [Brown & Burton, 1978, pp. 170-171) have demonstrated another ulilily of a student simulator, and this is as an 
environment in which student teachers can gain experience in building models of their pupils. They exposed student 
teachers to a simulator for elementary arillimciic skills. Iheir results showed that exposure to Iheir simulator signficantly 
improved the student teacher's ability to diagnose procedural bugs in a student's behavioi. 

Figure 5 illustrates the simulator by showing a trace of two simulated students on the same 
game. Ihe simulation in the upper half of the figure employs the rules specified by Mary's Overlay 
model. This rule set does not take account of double evidence, as was reflected in Mary's earlier 
choice of cave 14. (See figure 2.) Hence when faced witli the choice of cave 8 or cave 10, it 
.chooses cave 8, the riskier of the two. The simulator prints tlie explanatory message' for the choice 
of move 6 by fetching a description of tlie strategy nile that governed the decision. ITic second 
simulation is constnicted from the Overlay model for Jane, a more advanced player who does 
distinguish between single and multiple evidence as reflected in her use of BATl and nAT2 markers. 
(Sec figure 2 for Jane's represenuition of the warren.) Here tlic Jane simulacrum correctly chooses 
cave 10 as the better move. Hence, the simulator can serve a teacher who is interested in 
understanding the different behavioi: that two skill models might produce. 

Our third step was to represent the external data structures employed by the student. 

Supplying an historical perspective improves the range of explanations that the coach can 
deliver, but it is not sufficient as a teachable model of the problem solvjng process. Absent is, a 
representation of the objects on which problem solving rules operate. The coach, as yet, has no 
understanding of the problems involved in formulating a representation of the problem. Being both 
mathematician and historian is insufficient: the coach must also be an epistemologisL A more 
careful scrutiny of the knowledge demanded by the -problem - solving process is in order. 

Our attention was focuss^d on the need to consider the studenVs representation of the .state of 
the game, its history, and his hypotheses about the task by the following kind of situation. Students 
would frequently be able to explain a skill in isolation, yet not apply it when appropriate. This 
point was illustrated by thorson [1978], who conducted an experiment in which two populations of 
students were exposed to Wurnpus with different aids to, represent the game. Some were provided 
only pencil and paper; others a display version of thCcgame on which a map was automatically, 
drawn. The latter group played a much superior game of Wumpus, yet statistically' both groups 
possessed the same skills. " 
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Hence, it was necessary to extend our represenuuion of problem solving to include a 
representation of the evolving data representations employed by the student. To guide this 
extension, we observed the various representations employed by students, as illustrated in figure 2. 
We obsci-ved that some students built data representations tliat reflected their ignorance of the 
importance of certain information: for example, Mary did not realize that distinguishing single from 
multiple warnings for a danger was Aiseful. Other students assumed too much: a common bug of 
younger players was assuming that caves connected if they were drawn close to one another on the 
map. Still a tliird group of students created representations that proved adequate while the game 
was simple, but failed' when its demands grew complex. Johnny's table will make inferences about 
the connectivity of the warren complex as the game progresses. On the other hand, a fourth class 
of students employed redundant representations to facilitate different inferences. For example, Jane 
drew^both a map -and a list of visited caves: She used the former to reason about connectivity and 
tlic latter to infer the location of dangers by a process of elimination.N 

A Display-based Wumpus game was implemented to explore the role of data representation. 

To explore tire role of data and hypothesis representations in problem solving, we have 
implemented a display-based Wumpus in which the student can manipulate different data 
structures. The student is not allowed pencil and paper; hence, his entire external representation is 
in a form that tlie computer coach can observe. Display Wumpus ^allows the student or the coach 
to . select various daU^ representations for tlic connectivity of the warren and for ' hypotlieses 
formulated by the student regarding dangers from among those shown in figure 6. Here are some 
of the choices Display Wumpus permits: - ^ 

(1) Tlie warren can be described via the usual teletype description which prints 

the current caves, its neighbors and its warnings, or via a map. 

.- ' 

(2) Caves that the player has visited can be represented eitlier by dashing their 
outline or in the list labelled VISITED. 

(3) The player's current location can be represented either by tlie cave witli tlie" 
face or by the last entry to the TRAIL list. 
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(4) An hypotlicsis that a cave risks a particular danger can be grouped eitlier 
under the heading of the cave (on the map) or under the< heading of the 
danger (in the tabular evidence area). 

'llicsc representations are only a subset of those which a student might design on his own. We 
have restricted the student's freedom in return for increasing the coach's insight into his problem 
solving. However, Display Wumpus is only an experimental tool. To make it in^o a useftai 
educational environment, Display Wumpus could be provided with a tablet device so tLat tlie 
student can design his own representation while still allowing the coach to observe his behavior. 

Formally, Display Wumpus is based on tlic following point of view. For each type of evidence 
(that is, input and -output variable of a rule), there is a set of possible external representations, bor 
Wumpus, these representations include tables, maps, and the null representation, that is, no external 
representation at all. This selection of possible external representations is based on our experiments 
with children. We typically found an evolution of representation from the null representation, to 
tables like Johnny's, to maps like Mary's, 'tc ;:ombined representations like Jane's. We have also 
seen "representation traps'* in .which the player persists with a given representation, .say Johnny's 
tabular representation of the maze, and consequently finds it extremely difficult to progress to the 
acquisition of, more complex reasoning strategies. 

We arc now in the process of implementing a coach for Disphiy Wumpus. 



The current Display -Wumpus has sei'vcd as an experimental medium for several months in 
which we have observed tlie untutored play of many -students. We are now designing a coach to 
take advantage of the jarger window for observing the student's play which it provides. Hie new 
coach will maintain an Overlay Model of the student's use of the data representations supplied by 
Display Wumpus. For example, consider again Mary's map of figure 2. If this map is drawn with 
Display ampus, then the coach would construct the following description to supplement its 
overlay model of her problem solving skills: - 

DKSCKIPTION OVMARY^S PROBUCM RKPRKSKNl ATiON 



ATTRIBUTE 



VALUE 



WARMNGRKPIiSrNTATION 
NMGJ inOR-RKl»RI-:SKNTA'riON 
DANGFRRKPRllSKNTATION 
VISITI- D'RKPRIISEN lATION' 



MAP cMARY RECORDS TIIE DRAFF ON THE MAP 
MAP \AND THE NEIGHBORS, 

NONE- \nUr NOT THE CAVES THAT RISK PrfS, . 
NONE \NOR THE WISHED CAVES. 
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With this description, the coach will be capable of explaining asjceriain representation if it 
believes that the student knows the appropriate rules, but is not representing the data in a way that 
would nnake their application evident. For example, suppose Johnny selected cave 14 as his next 
move. Recall that earlier, when Mary selected this move, the coach discussed wilh-her the increased.^ 
danger implied by double evidence. Iiu?%Jinny's problem may simply be that he docs not 'realize 
that cave 0 is implicated both by the warning in cave 15 and theVarning in cave 4. His tabular 



representation requires that he infer that 14 t'\ connected to both by examining two rows of the 
table. It is not as easy an inference as it is'for f^ry with her graphie representation of tlie warren. 
In this situation, we envision the following dialog: 



Explanation 115: Johnny, do you realize that cave 14 is risky both because of the 
warning in cave 15 and the warning in cave 4? Using tables makes this difficult to 
see. Perhaps you would like to employ a map? 



Ilie -coach would then instruct Display Wumpus to provide a map similar to the one shown in 
figure 6, but simplified by removing the danger symbols (PITl, PiT2, etc.). These symbols along with 
die list representation would not be offered since Johnny's level of play does not yet warrant 
proposing this additional machinery. Johnny could then choo.se to employ the map by using tlie 
apprbpriate drawing commands of Display Wumpus. Thus, the coach tloes not engage in a 
discussion of the probabilities implied by dbuble evidence, but addresses Uie prerequisite necessity 
to help Jforinny with his* representation. . . 



Qur fourth step was to represent the resource limitations of the problem solver. 



fn the previous section, we provided the coach witli knowledge regarding the various data 
stmctiires a student might employ to represent the problem. /ITiis knowledge is necessary but not 
sufficient to gXiide tlie coach in its generation of explanations like E5; such^ knowledge does not 
determine when the corresponding advice is apprdpriatc. For example, in the above situation, it 
may be premature to suggest a map to Johnny. The game mpy still be too simple to stress the table 
representation. Tutoring leverage will not exist until -Johnny perceives the. inadequacies of his 
current representation scheme relative to thc.compfcxitrof^the problem- lluis, whether 6r not 
advice about a change in representation is appropriate depends on an estimate of the cogjiitivc load 
that the problcln imposes on the student. Hence, an epistemologist's insight into the breadfh of 
knowledge required by the task must be supplemented by, a psychologist's insight into the relative 
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complexity of the material. 

An elementary method for estimating the complexity of the game was implemented. 

The coach estimates the complexity of the game in terms of tlic number of dangers, the number 
of caves, the propagation distance of warnings and the mobility of the dangers. Increasing any of 
these paramietcrs is assumed to increase the complexity of the taskr This is borne out by our 
infonnal experiments with students and by the intrinsic computational work that the problem solver 

is required to pcrfonn. • 

I . 

The coach currently employs its student model to guide, its selection of the complexity of the 
Wumpus task presented to the student. The fact that Mary was presented with a game of 15 caves, 
2 bats, 2 pits and I stationary Wumpus was not accidental, Had she been a novice, she would have 
been exposed to onjy 1 bat,.l pit and a warren of 10 ^avcs. When she becomes an expert, the 
Wumpus is allowed to move when attacked and the number of bats and pits is increased to tliree. 

' 

A tlieory-bascd estimate of cognitive load 1s needed. 

The elementary rhethod for estimating the complexity of the game described above was.added .to 
the the coach when it became clear that tlie advanced game was too complex for beginners. But 
this method was not based on a deep theory of cognition. Our current research addresses this issue 
by constructing a more formal model of the problem solver. ■^ Our plan is to include an explicit 
representation of the resources required by the problem solving interpreter to apply a given^set of 
skills. This would, include such process-oriented parameters as: depth and breadth of tlie search 
space; the complexity of the data structures being maintained in tenns of their size;- the complexity 
of the patterns of individual rules in terms of the number of variables they access and and the 
number of conjuncts or disjuncts in tlieir pattern; and the number of rules matching particular 
patterns. It Would also include a representation for memory load as reflected by the number and 
six.c of the data structures that must be maintained. The extension then is to represent various 
limits on these resources. 

lliere is no a priori reason why the load points of the Expert module's problem solving program 
should correspond to the load points encountered by a human problem solver.^ Perhaps they solve 
problems- in very different ways. Tliis is theoretically possible. However, rememj:)er tliat Uie 
problem solving skills have been formulated in a very anthropomorphic fashion. They have been 
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carefully broken into small pieces, comprehensible to the learner. This does not guarantee a 
correspondence in workload, but it suggests one. Hence, pur starting point for. a psychological 
model of the student's resource limitations will be tlie load points of our Fixpert program. There is 
a second rationale for this starting point. Recall that our orientation is teacher-centered. Hence, 
tliesc load points are^ those suggested to a teacher beginning his course from a particular pcspective 
on the syllabus. This does not obviate the need to investigate the psychological reality of this 
resource model: it only provides a storting point. Hence, a future goal will be to correlate this 
theoretically motivated formulation with the psychological literature on cognitive load. (See 
Norman & Bobrow, 1975 for a discussion of data-limited and resource-limited processes from a 
'psychological perspective.) 

As usual, extending the underlying problem solving representation allows tlie Overlay Model of 
the student to be more accurate. l*he representation for tliis augmented model, however,, goes 
beyond the individual rules. An explicit model of tlie problem solver is required. Again \Vc 
propose to employ an attribute value description. The attributes are the load dimensions: the values 
•are the thresholds at which the student is expected to fatter. 

OFSCRirnON OF M.\UY*S PROBLKM SOLVING CAPAQTY 

RRPRKSKNTATION I-S'llMATr.n COCTUSION TyJUKSlIOLD 

NULL , ShT IIXCUEDS 3 ELEMfiNTS.. 

IJST SET CXCIII'DS 5 ELEMfiNTS. 

MAP . ■ SEr EXCEEDS 15 ELEMENTS. 

'ITiese thresholds are estimates based on experience with various students. The coach would have a 
table of such cstiJTiates for students of various age and skill backgrounds. 

An interesting consequence of. representing cognitive load factors is that we have a rationale for 
die apparently redundant data structures provided by Display Wumpus. Examine figure 6 again 
ahd observe that the caves which risk bats arc represented_explicitly. as a list under the label BAT+ 
as well as by means of BAT-h symbols in the appropriate" caves. Logically these representations are 
ecj'ur^enL But cognitively, the list^representation makes it cheap to compute how many caves are 
among tM;candidates for the bat's nest, while die map representadon tnakes this expensive. The 
Tlrst'requiresXsinglc data fetch on the HAT-f list while die. second requires a data fetch on every 
cave to see iF it coiUains the BAT+ symbol. On the other hand, the map oriented representation 
makes it, cheap to deadc if a particular cave risks bats. Thus there is a rationale for both. This is 
supported by die our experience that expert players maintain bodi .kinds of data slnictures. 
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^Eixtcnsions to the underlying problem solving representation also improve the utility of the 
Student Simulator. The perfonnance of a particular mle model. and associated data representation 
can be examined under different load thresholds. We plan to allow the user to set such thresholds 
as the maximum number of hypotheses that can be remembered implicitly with no error or the 
maximum number of predicates in a mle condition that can be executed with no error. 

There are more steps to be taken iii constructing an adequate problem solving 
model. 

'lliis paper has recounted the development of our problem solving model from an unorganized 
set of mles to a network represention of an evolving set of rules acting on* an evolving data 
representation and executed by a resource limited problem solver. Tlie forcing function has been, 
the design of an adequate coaching system. Our response has been to provide the coach with 
multiple perspectives on its subject matter by incorporating tlie viewpoints of a mathemaiicicuu an 
historian, an epislemologist and a psychologist, The result is a teaching artifact tliat exhibits a deeper 
understanding of its subject matter as exhibited by the range* of explanations it can generate. 

i ■ . ■ 

Tlie four steps we have described, however; do^ not exhaust the knowledge that a problem 
solving theory.must represent. In this section, I enumerate several extensions,. wjth proposals for (1) 
how to incorporate tliem into our^problem solving model, and (2) how to extend the Wumpus game 
environment to improve its utility as an. experimental base for examining these issues. 'Hiese 
extensions are intended to incorporate within the coach the additional 'perspectives of the manager, 
the learner,. ^IhQ scholar and the" bookkeeper. ; 

IIjc manager. Our discussion of i)roblem solving ignored the organizational skills needed to 
manage large numtiers of individual skills> This management includes such ftjnctions as selecting 
appropriate skill sets to apply to the current problem, organizing tlieir order of application, and 
removing^- inappropriate skill sets. In the artificial intelligence ..literature, .this class of problem 
solving knowledge has been explored by Davis [1978] in tlie context of improving the problem 
solving behavior of the MYCIN medical diagnosis program. Davis supplies meta-niles to represent 
this class of knowledge. ITie Wumpus ru.1e network should be extended to incorporate tliis 
knowledge ex:plicitly, providing, for example, an explicit representation. of metaTrules for governing 
tlie order of application of individual strategies. By supplying these meta-rules, the, coach could 
maintain an improved overlay model by measuring the use and "appropriateness of various meta- 



Goldstein 




strategies in tlie student's play. 



The learner. Our discussion of problem solving also skirted the representation of learning skills. 
A preliminary step was. taken by specifying potential evolutionary relationships between niles in the 
skill network, but it did not characterize the learning processses involved. Again vy? pjajLtq^^.d^^^^ 
from the artificial intelligence literature. Newell and Moore [1973] describe the formal structure of 
analogies in terms of mappings between the attributes ot the objects being compared. Hence, a 
natural extension of our rule network is to replace tlie labels on analogy links with descriptions of 
die mappings between tlie attributes of the connected rules. Such descriptions would record, for 
. example, that bats and pits are analogous with respect to the disuince their warnings propagate but 
not analogous with respect to the degree of danger which they imply. Doing so would allow the 
Tutor module to be more explicit in its advice about potential analogies. 

■ The scholar. - Another extension is required to rcpvcsQni declaralive knowledge. We have taken a 
procedural viewpoint throughout this paper. Adding organizational and learning skills continues in 
this vein. Biit clearly not all of an individual's problem solving knowledge is nile-like. Such an 
emphasis fails to take account of the factual knowledge that an -individual uses to justify the 
. application of particular rules or to deduce those ailes in tlie first place. The artificial intelligence 
literature has explored the interplay betwceu dGftlarative knowledge (pften expressed in the predicate 
calculiis) and procedural knowledge. For example. Green [1969] explored die derivation of 
progranis from proofs. This class of knowledge must ultimately be included if the coach is to ' 
understand how to offer advice that emphasizes the governing principle rather . dian tlie specific 
rules. ^ As a first.stcp. we plan to include /ac/ nodes in the syllabus network to rep/esent,the logical 
axioms of Wumpus. For. example, the axiom of Wympus diat "/( cave eijher contains' d danger or is 
hfe, but not both:' would be represented explicitly. ITiis fact justifies several rules, but is not_itself 
explicitly procedural. The fact node would be linked to the rules it justifies. By adding these fact 
nodes, we will improve Both tlie overlay modelling capability of die coach and th> range of advice 
that can be offered. ~ " ' - 

; _ • ' • a 

The bookkeeper.. In our emphasis on rules, we. have also largely ignored the episodic structure of 
memory. The coach js based on die" presumption that tutoring by example is fijndamental to 
learning. But the -coach has no representation for the interrelationships between particular tutorial, 
episodes and the.mles diey explain. Consistent widi the four steps taken in this paper, our. plan -is 
to broaden the attribute description of individual ailes by providing links to nodes describing 
- tutorial interactions witii the student: .This should have a visible return by giving die coach die 
ability to estimate whether or not a partfcular rule will* be remembered., 'Fhe coach could base this 
hypothesis- on the niimber of explanations, dieir frequency and their recency, all of which woyld'be 
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recorded in the extended rule description. ^ 

To increase our leverage to explore these extensions, we intend to generalize the Wu:npus game 
by multiplying its cast of characters. We plan to extend its fairy tale motif by adding such 
characters as dwarves, dragons, princes and princesses. Each character will have it own kind of 
behavior and generate its own kind of evidence. We expect that these extensions will bring into 
clearer focus the organizational skills for managing larger sets of problem solving heuristics; tlie 
learning skills for Uiking advantage of the larger number of possible analogies/ generalizations and' 
rifinements that the extended world suggests; and the memory skills for properly organizing a more 
diverse set of experiences. However, these extensions still preserve the closed and tractable 
properties of the game environment which make it a desirable experimental domain. 

A computational theory orproblem sr/lving has many educational applications. 

Predicting drastic* reductions in the cost of computers is now commonplace. Less clearly 
foreseen is their potential to perform as problem solving tools. Of course, a calculator is such ii tool. 
But J'have in mind a more extensive role for these machines in which they ti:uly*know something 
about tlie task aiid contribute accordingly. In this paper, we considered only the coaching role. 
However, here are three related- roles that, like ;^ the coach, are based upon a computational 
^representation for problem solving skills. 

(1) ^Computers could serve as personal assistants in which the computer assumes some part of the 

problem solvin^^ task, thereby freeing the student to solve -more complex problems.. Display 
Wumpus is a simple example of such an assistant. Thorson [197S] demonstrates the fashion in 
which Display Wumpus can free students to reason about the logical complexity of the game 
without being confused by its geometric structure. • 

(2) Computers could provide" cognitive programming environments in which students implement 
their own problem solving programs, la this fashion, students can gain more intimate 
understanding of the subject matter in an active and exciting fashion. To explore this role, we 
are- developing a. Programmable Wumpus in which the student does not pjay. but rather 
specifies thahiles to be employed by a computer player who represents- him on the playing 
field. Thus'\he student acquires experience with problem solving by acting as tlic teacher 

rather than the student. , * ^ ^ \' 

«» * • . 

(3) Computers could provide cognitive simulation environments in which the consequences of 
various learning and teaching strategies are :Cxplored;> Our Student Simulator is a forerunner 
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of this application. Potentially such simulations could serve the same role in education as 
wind tunnels do in aeronautics, namely a low cost, low risk environment for examining the 
behavior of scale models of students. 



'ITie potential impact of computers as problem solving tools is interesting to project, but clearly 
this projection must not blind us to the many difficult problems that must first be solved. 'Iliese 
'problems do not lie in building powerful hardware, but rather in developing an adequate 
understanding of the problem solving process. Tliis paper has described one methodology for 
acquiring this understanding - the development of computer coaches. Future research will 
undoubtedly include the development of consultants, assistants, and simulators as additional 
instruments for stressing and testing our theories of cognitive skills. 
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Fi^'.i 1 . A simpified, block diagram of a computer coach. 
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Fig. 2. Player's representations of the game. 
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ER3P^ 



N is {he set of neighbors of the current cave. 

VISITED is the set of caves that have been visited. 

FRINGE is the set of unvisited caves adjacent to visited caves. 

D+ are sets of caves that possibly risk a danger. 

D- are sets of caves that are safe fronn a danger. 

D1 are sets of caves for which there is single evidence of a danger. 

D2 are sets of caves for which there is double evidence of a danger. 



Fig. 3. A region of the Wumpus skill network concerned with evidence rules. 
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A dark outline signifies a rule hypothesized to be known by the player. 
A double outline signifies a rule explained to the player. 

A dashed link signifies that an explanation corresponding to that link has been generated. 
El through E4 are the corresponding explanations in the text. 



Fig. 4. An overlay model for a region of the skill network. 
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Mary simulation move 6: Move risks batis but is safe from pits. 



0 



WUM + 



11 



SQUEAK^ 



BAT + 



SMELL 




SQUEAK 6 ^ 
1^ 




Jane simulation move 6: Prefer single evidence if we must risk bats. 
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Dashed arrows signify the path of the^simulated student. 

Fig. 5. Divergent behavior of two simulated students. 
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Fig. 6. The map and list representations provided by Display Wumpus. 
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